J. LOGIC PROGRAMMING 1994:19, 20:1-679 



1 



EXTREMAL PROBLEMS IN LOGIC 
PROGRAMMING AND STABLE MODEL 
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TRUSZCZYNSKI 



t> We study the following problem: given a class of logic programs C, de- 
termine the maximum number of stable models of a program from C. We 
establish the maximum for the class of all logic programs with at most n 
clauses, and for the class of all logic programs of size at most n. We also 
characterize the programs for which the maxima are attained. We obtain 
similar results for the class of all disjunctive logic programs with at most 
n clauses, each of length at most m, and for the class of all disjunctive 
logic programs of size at most n. Our results on logic programs have direct 
implication for the design of algorithms to compute stable models. Sev- 
eral such algorithms, similar in spirit to the Davis-Putnam procedure, are 
described in the paper. Our results imply that there is an algorithm that 
finds all stable models of a program with n clauses after considering the 
search space of size 0(3"/^) in the worst case. Our results also provide 
some insights into the question of representability of families of sets as 
families of stable models of logic programs. <] 



1. INTRODUCTION 

In this paper we study extremal problems appearing in the context of finite propo- 
sitional logic programs. Specifically, we consider the following problem: given a 
class of logic programs C, determine the maximum number of stable models a pro- 
gram in C may have. Extremal problems have been studied in other disciplines. 
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especially in combinatorics and graph theory | Bol78 |. However, no such results for 
logic programming have been known so far. 

We will consider finite propositional disjunctive logic programs built of clauses 
{rules) of the form 

ai V . . . V flfc <- 61, . . . , 6„i, not(ci), . . . , not(c„), 

where a^, hi and Ci are atoms. In an effort to establish a semantics for disjunctive 
logic programming, Gelfond and Lifschitz [GL91| introduced the notion of an answer 



set of a disjunctive program. It is well-known that for normal logic programs (each 
clause has exactly one literal in the head), answer sets coincide with stable models 
pL88| |GL9| . We wiU denote the set of answer sets of a disjunctive program P 



(stable models, if P is normal) by ST{P) and we will set 
s{P) = \ST{P)\. 

Given a class C of disjunctive programs, our goal will be to determine the value 

of 

max{s(P):F e C}. 

We will also study the structure of eitremaZ programs in C, that is, those programs 
in C for which the maximum is attained. 

We will focus our considerations on the following classes of programs: 

1. 'DVn,m — the class of disjunctive programs with at most n clauses and with 
the length of each clause bounded by m 

2. CVn — the class of normal logic programs with at most n clauses. 
We will establish the values 

s{n) = max{s(P): P G CVn} 

and 

d{n,m) = max{s(P):P € T>Vn,rn}- 

We will show that s{n) — 0(3"^'^) (an exact formula will be given) and d{n,m,) = 
m", and we will characterize the corresponding estrema/ programs. 

We will also show that the bound for logic programs can be improved if additional 
restriction on the length of a clause is imposed. We will study the class £^ of logic 
programs with n clauses such that each clause has at most one literal in its body. 
We will show that if P is in Cl, then s(P) = 0(2"/*). 

We will also study classes of programs defined by imposing restrictions on the 
total size of programs. By the size of a program P, we mean the total number of 
atom occurrences in P. We will investigate the following classes of programs: 

1. TyPn — the class of disjunctive programs with size at most n 

2. CV[^ — the class of normal logic programs with size at most n 

and obtain similar results to those listed above. 

The motivation for this work comes from several sources. First of all, this work 
has been motivated by our efforts to develop fast algorithms for computing stable 
models of logic programs. It turns out that bounding the number of stable models 
and search for extremal logic programs arc intimately connected to some recursive 
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algo rith ms fo r computing stable models. Two results given in Section (Corollaries 
2.1 and 2.2) imply both the bounds on the number of stable models, and a whole 
spectrum of algorithms to compute stable models. These algorithms share some 
common features with the Davis-Putnam procedure for testing satisfiability of CNF 
formulas. One of these algorithms is similar to the algorithms recently described 
and studied in |SNV95, Nie95, NS95|. The corollaries also imply the worst-case 
bounds on the size of the search space traversed by those algorithms. 

Let us note here that in order to lead to implemented systems for computing 
stable models, several research issues remain to be resolved. In particular, heuristics 
for choosing atoms and rules in the algorithms presented in Section ^ must be 
studied. Simlarly, the effects of using well founded semantics as a preprocessing 
mechanism, which is known to be critical for the performance of the s-models 
system [ NS96| , has to be investigated. Finally, in order to gain actual insights into 
the quality of the algorithms proposed here and compare them to other systems 
(such as s-models), extensive experimental studies is necessary. All these issues are 
the subject of our current studies. 

Additional motivation for our work presented here comes from considerations of 
expressive power of logic programming and of representability issues. Both concepts 
help understand the scope of applicability of logic programming as a knowledge 
representation tool. Disjunctive logic programs with answer set semantics (logic 
programs with stable model semantics) can be viewed as encodings of families of 
sets, namely, of the families of their answer sets (stable models). A family of sets 
T is representable if there is a (disjunctive) logic program P such that 

ST{P) = T. 

Important problems are: (1) to find properties of representable families of sets, 
and (2) given a representable family of sets to find possibly concise logic pro- 
gram representations of Related problems in default logic have been studied in 
[ MTT96{ . It is well-known | GL9l| that every representable family of sets must be 
an antichain. Our study of extremal problems in logic programming provide ad- 
ditional conditions. Namely, every family of sets representable by a program from 
'D'Pn,m must have cardinality bounded by m" and every family of sets representable 
by a logic program from CVn must have size bounded by 3"/'^. The best bound 
known previously for families of sets representable by logic programs from CVn was 
w 0.8 X 2"/V^. 

In addition, the results of this paper allow some comparison of the expressive 
power of different classes of programs. For example, there is a disjunctive logic 
program of size n with 0(2"/^) 

answer sets while the largest cardinality of a family 
of sets representable by a logic program of size n is only 0(2"/'*). This observation 
might perhaps be interpreted as evidence of stronger expressive power of disjunctive 
logic programs. A formal definition of the appropriate notion of expressiveness and 
its properties are open areas of research. 

To make the paper self-contained we will now recall the definitions of a stable 
model and an answer set []GL88 , GL91 |. Let P be a (disjunctive) propositional logic 
program built of atoms in the set At. Let M C At. By the Gelfond-Lifschitz reduct 
of P with respect to M, denoted by P^^, we mean the program obtained from P 
by: 



1. removing from P all rules with a literal not (a) in the body, for some a e M 



2. removing all negative literals from all other rules in P. 



If P is a normal logic program (no disjunctions), P^^ is a Horn program. Con- 
sequently, this logic program has its least model iA/(P*^). A set of atoms M is a 
stable model of P if M = LM{P^'). 

If P is a disjunctive logic program, instead of the notion of a least model of P^^ 
(which may not exist) , we will use the concept of a minimal model. A set of atoms 
M is an answer set for P if M is a minimal model for P^^. 

The paper is organized as follows. In the next section, we present our main results 
on normal logic programs. In particular, we determine s(n) and characterize the 
class of extremal logic programs. The following section discusses the implications 
of these results for the design and analysis of algorithms to compute stable models. 
In Section ^, we study disjunctive logic programs and the last section contains 
conclusions. 



NORMAL LOGIC PROGRAMS 

In this section we study extremal problems for normal (non-disjunctive) logic pro- 
grams. We will determine the value of the function s(n) and we will provide a 
characterization of all programs in the class CVn which have s{n) stable models. 
No bounds on the length of a clause are needed in this case. It is well known 
that each stable model of a program P is a subset of the set of heads of P. Con- 
sequently, s{n) < 2". This bound can easily be improved. Stable models of a 
program form an antichain. Since the size of the largest antichain in the alge- 
bra of subsets of an n-element set is (|^„"2j) ~ ^-^ ^ 2"/y^, it clearly follows 
that, s{n) < 0.8 x 2'^/y/ri. We will still improve on this bound by showing that 
s{n) = e(3"/3) « e{2°-^^^") « 0.8 X 2"/^^. We obtain similar results for the 
class CVn of logic programs with n clauses each of which has at most one literal 
in the body, and for the class CV'^ of all logic programs with at most n atom 
occurrences. 

Our approach is based on the following version of the notion of reduct first 
described in |Dix94 | and, independently, in [3NV95]. Let P be a logic program and 



let T and F be two sets of atoms such that Tn P = 0. By simp{P, T, F) we mean 
a logic program obtained from P by 

1 . removing all clauses with the head in T U P 

2. removing all clauses that contain an atom from F in the body 

3. removing all clauses that contain literal not(a), where a G T, in the body 

4. removing all atoms a, a G T and literals not(a), a G P, from the bodies of 
all remaining rules. 

The simplified program contains all information necessary to reconstruct stable 
models of P that contain all atoms from T ("make them true") and that do not 
contain any atoms from P ( "make them false" ) . The following result was obtained 



in [|Dix94| (see also [ pNV95| ). We provide its proof due to the key role this result 



plays in our considerations. 
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Lemma 2.1. Let P he a logic program and let T and F he disjoint sets of atoms. If 
M is a stahle model of P such that T C M and M n F = 0, then M\T is a 
stahle model of simp{P, T, F) . 

Proof. Let us define a partition of P into five disjoint programs Pi, . . . , P5 (some 
of them may be empty): 

1. Pi consists of all clauses in P with the head in T 

2. P2 consists of all clauses in P with the head in F 

3. P3 consists of all the remaining clauses in P that have an atom a, where 
o e P in the body 

4. P4 consists of all the remaining clauses in P that have a literal not(a), where 
a e T in the body 

5. P5 consists of all remaining clauses in P 

It is clear that simp{P, T, F) = simp{P^, T, F). 

Let M be a stable model for P such that T C M and M n P = 0. Since M is 
the least model of P^, M is a model of Pg*^. Define M' = M \ T. We will show 
that M' is a model of simp{P^,T,F)^ . Consider a clause 

a^bi,...,bk 

from simp{P5, T, F)^^ such that {5i, . . . , 6fe} C M'. By the definition of Gelfond- 
Lifschitz reduct, there is a clause 

a ■*— 61, . . . , 6fc, not(ci) . . . , not(cr) 

in sim,p{Pc,,T,F) such that c, ^ M, 1 <i <r. Furthermore, by the definition of 

simp{P5,T, F), there is a clause 

a^bi,.. .,bk,bk+i, . . . ,5j,not(ci) . . . , not(cr), not(cr+i), . . . ,not(cs) 

in P5 such that hi £ T, k + 1 < i < I, and Cj G P, r + 1 < i < s. Since P n M = 0, 
it follows that the clause 

a ■*— 61, . . . , 6fc, bk+i, . ■ . ,bi 

belongs to P^. Moreover, since T C M, {hi, .... 6;} C M. Since M is a model 
of P^ , a € M. By the definition of programs Pi, a ^ T. Hence, a € M' and, 
consequently, M' is a model of simp{P^, T, P)*^. 

Consider a model M" of simp{P5,T, F)^ . Assume that M" C M' . Observe 
that M" U T is a model of Pf. Since P n (M" U T) = 0, M" U T is a model of 
Pg^. It is also clear (T C M) that P/^ = 0. 

Consider a rule 

a ■*— 61, . . . , 6fc 

from P^ . Since M is a model of P^ and since a ^ M (recall that a e P and 
M n P = 0), there is i, 1 < i < k, such that 6, ^ M. Since M" U T C M, 
bi ^ M" U T. Thus, any rule in P^^ is satisfied by M" U T. 
Finally, consider a rule 

a<- 6i,...,6i 
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from Pg*^. Assmiie that {61, . . . , 6/} C M" U T. Without loss of generality, we may 
assume that {6fc+i, . . . , 6/} are the only fejS that belong to T. Then, {&i, . . . , hk} C 
M" and 

a ^ 61 , . . . , 6fc 

is in simp{P5,T, P)*^. Since M" is a model of simp{P5,T, F)*^ a E M" . 

Thus, it follows that AI" U T is a model of and, taking into account the 
observations made earlier, also of P^ . Since M"UT C M and since M is the least 
model of it follows that M" U T = Af . Since M" n T = 0, it follows that 
M" = Af. Consequently, Af' is the least model of simp{P5,T, F)^ . By the defi- 
nition of PiS, it follows that simp{P5, T, F)^ = simp{P5, T, F)^ . Moreover, since 
simp{P, T, F) = simp{P5,T, F), we have that simpiP^, T, F)*^ = simp{P, T, Pf. 
Therefore, M' is the least model of simp{P,T, F)^'^ and, consequently, a stable 
model of simp{P, T,F). □ 

In general, the implication in this result cannot be reversed. However, it is well 
known [ pNV95[ that if T and F are the sets of atoms respectively true and false 



under the well-founded semantics for P, then the converse result holds, too. That 
is, for every stable model M' of simp{P, T, F), M' U T is a stable model of P. 
Let P be a propositional logic program and let q be an atom. We define 

1. P{q+) = simp{P,{q},^) 

2. P{q-)^ simp{P,^,{q}). 

Programs P{q^) and P{q^) are referred to as positive and negative reducts of P with 
respect to q, respectively. Intuitively, P{q~^) and P(g~) are the programs implied 
by P and sufficient to determine all stable models of P. Those stable models of P 
that contain q can be determined from P ((/+), and those stable models of P that 
do not contain g, from P{q~). Formally, wc have the following result. 

Corollary 2.1. Let P be a logic program and q be an atom in P. 

1. Let M be a stable model of P. Lf q E M then M \ {(7} is a stable model of 
Piq+). Lfq^M then M is a stable model of P{q-). 

2. s{P)<s{P{q+)) + s{P{q-)). 

Similarly, we will define now positive and negative reducts of P with respect to a 
clause r. Assume that r — q ^ ai, . . . , a^, not(5i), . . . , not(5/). Then, define 

1. P(r+) = simp{P, {q, oi, . . . , a^}, {61, . . . , 6;}), and 

2. P{r-) = P\{r}. 

We say that a logic program clause r is generating for a set of atoms S if every 
atom occurring positively in the body of r is in S' and every atom occurring negated 
in r is not in S. Using the concept of a generating clause, the intuition behind the 
definitions of P(r+) and P{r~) is as follows. The reduct P(r+) allows us to compute 
all those stable models of P for which r is a generating clause. The reduct P(r~), 
on the other hand, allows us to compute all those stable models of P for which r is 
not generating. More formally, we have the following lemma. 

Corollary 2.2. Let P be a logic program andr = g ^ ai, . . . , a^, not (61), . . . , not (6;) 
be a clause of P. 
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1. Let M he a stable model of P. If {ai, . . . ,a,k} Q M and {61, . . . ,5;}nM = 
then M\ {q, ai, . . . , a^} is a stable model of P{r^). Otherwise M is a stable 
model of P{r~). 

2. s{P) < s{P{r+)) + s{P{r-)). 

Also in the case of this result, the implication in its statement cannot be replaced 
by equivalence. That is, not every stable model of the reduct (P(r+) or P(r~)) 
gives rise to a stable model of P. 



It should be clear that Corollaries 2.1 and 2.2 imply recursive algorithms to 



compute stable models of a logic program. We will discuss these algorithms in the 
next section. In the remainder of this section, we will investigate the problem of 
the maximum number of stable models of logic programs in classes CVn, ^"Pn ^-^^ 

To this end, we will introduce the class of canonical logic programs and determine 
for them the number of their stable models . We will use canonical programs to 
characterize extremal logic programs in the class CVn- 

Definition 2.1. Let A = {ai, 02, . . . , Ofc} be a set of atoms. By c{ai) we denote the 
clause 

c{ai) = not(ai), . . . , not(ai„i), not(ai+i), . . . , not(afc). 

A canonical logic program over A, denoted by CP [A], is the logic program con- 
taining exactly k clauses c(ai), . . . , c{ak), that is 
fe 

CP[A] = U{c(a.)}. 

Intuitively, the program CP[A\ "works" by selecting exactly one atom from A. 
Formally, CP[A] has exactly k stable models of the form Mi = {a^}, for i = 1, . . . , fc. 

Definition 2.2. Let P be a logic program and A be the set of atoms which appear 
in P. Program P is a 2, 3, A-program if A can be partitioned into pairwise disjoint 
sets Ai, . . . ,Ai such that 2 < < 4 for i = 1, . . . ,1, and 



P = U CP[Ai 



i=l 



Roughly speaking, a 2, 3, 4-program is a program which arises as a union of 
independent canonical programs of sizes 2, 3 or 4. A 2, 3, 4-program is stratified in 



the sense of [ Cho95 | and the canonical programs are its strata. Stable models of 
a 2, 3, 4-program can be obtained by selecting (arbitrarily) stable models for each 
stratum independently and, then, forming their unions. 

By the signature of a 2, 3, 4-program P we mean the triple (A2, A3, A4), where A^, 
i = 2, 3, 4, is the number of canonical programs over an i-element set appearing in 
P. 

Up to isomorphism, a 2, 3, 4-program is uniquely determined by its signature. 
Other basic properties of 2, 3, 4-programs are gathered in the following proposition 
(its proof is straightforward and is omitted). 
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Proposition 2.1. Let P he a 2,5,4:-program with n clauses and with the .signature 
(A2,A3,A4). Then: 

1. n = 2A2 + 3A3 +4A4, 

2. s{P) = 2^^3^H^^. 

As a direct corollary to Proposition we obtain a result describing 2,3,4- 
programs with n clauses and maximum possible number of stable models. For 
A; > 1, let us define A(k) to be the unique (up to isomorphism) 2, 3, 4-program with 
the signature (0,A:,0), and C{k) and C"(fc) to be the unique (up to isomorphism) 
2, 3, 4-programs with the signatures (2, fc— 1, 0) and (0, fc— 1, 1), respectively. Finally, 
for fc > 0, let us define B{k) to be the unique (up to isomorphism) 2, 3, 4-program 
with the signature (l,fc,0). 

Corollary 2.3. Let P be a 2,3,4:-program with n clauses and maximum number of 
stable models. Then, 

1. if n — 3k for some k > 1, P = A{k), 

2. ifn = 3k + l for some k>l, P = C{k) or C'{k), 

3. if 3k + 2 for some k>0, P = B{k). 

Consequently, the maximum number of stable models of an 2,3, 'i-programs with 
n clauses is given by 



We will show that s{n) = So{n). We will also determine the class of all extremal 
programs. 

We call an atom q occurring in P redundant if q is not the head of a clause in 
P. Let P be a logic program. By P we denote the logic program obtained from P 
by removing all negated occurrences of redundant atoms. We define the class £„ 
to consist of all programs P such that 

1. P is A{k), if n = 3fc (fc > 1), 

2. P is B{k), if n = 3fc + 2 (fc > 0), or 

3. P is C(fc) or C"(fc), if n = 3fc + 1 (fc > 1). 

Theorem 2.1. If P is an extremal logic program with n > 2 clauses, then P has 
S(){n) stable models. That is, for any n > 2 

s{n) = Soin). 

In addition, the extremal programs in CVn «re exactly the programs in ■ 




Corollary ^ implies that so(n) = 6(3"/^) and that 
s{n) > soin) > 3"/^ 



(2.1) 



9 



Theo rem 2.1 can be proved by induction on n. The proof rches on Corollaries 2T 
and 2.2 that establish recursive dependencies between the number of stable models 
of P and of its reducts. It is rather lengthy and, therefore, we provide it in the 
appendix. 



The general bound of Theorem 2.1 can still be slightly improved (lowered) if the 
class of programs is further restricted. Since there are extremal programs for the 
whole class CVn with no more than 2 literals in the body of each clause, the only 
reasonable restriction is to limit the number of literal occurrences in the body to 
at most 1. The class of programs with n clauses and satisfying this restriction will 
be denoted by CV^. 

Denote by P{k) a 2, 3, 4-program with signature (fc,0,0). Clearly, P{k) g CP^. 
We have the following result. The proof uses similar techniques as the proof of 



Theorem 2.1 and is omitted. 



Theorem 2.2. For every program P G ^Pn, s{P) < 2l^"/^J. Moreover, there are 
programs in LP^ for which this hound is attained. Program P{k) is a unique 
(up to isomorphism) extremal program with n ~ 2k clauses, and every extremal 
program with n = 2k + I clauses can be obtained by adding one more clause to 
P{k) of one of the following forms: p ^ a, a <— , and a <— not(6), where p is 
an arbitrary atom (may or may not occur in P{k)), and a and b are atoms not 
occurring in P{k). 

Next, we will consider the class CP[-^ of all logic programs with the total size 
(number of literal occurrences in the bodies and heads) at most n. Let s'(n) be 
defined as the maximum number of stable models for a program in CP'„. We have 
the following result. 

Theorem 2.3. For every integer n > 1, s'(?i) = 0(2"/"*). 

Proof. We will show that for every n > 1, and for every logic program of size at 
most n, s{P) < 2'^/'^. We will proceed by induction. Consider a logic program P 
such that the size of P is at most 4. If P has one rule, then it has at most one 
stable model. If P has two rules and one of them is a fact (rule with empty body), 
then P has at most one stable model. Otherwise, P G CP^ and s(P) < 2^/^^ follows 



from Theorem 2.2. If P has three rules, then at least two of these rules are facts 
and P has at most one stable model. If P has four rules, it is a Horn program and 
has exactly one stable model. Hence, in all these cases, s{P) < 2"/'*. Since P has 
size 4, it has at most four rules and the basis of induction is established. 

Consider now a logic program P of size n > 4. Assume that P has a rule, r, 
with at least two elements in its body. Let a be the head of r. If a and not (a) do 
not occur in the body of any rule in P\ {r}, then s{P) < s{P \ {r}) and the result 
follows by the induction hypothesis. So, assume that there is a rule in P\ {r} such 
that a or not(a) occurs in its body. Then, both P{a^) and P{a~) have sizes at 



most n - 4. By Corollary |2.l|, s(P) < s(P(a+)) + s(P(a")). Consequently, by the 
induction hypothesis, s(P) < 2"/"'. 

Thus, assume that each rule in P has at most one literal in its body. If at least 
one of these rules, say r, has empty body, then every stable model of P contains 



the head of r (say a). Thus, s(P) < P(a ) (Corollary 2.1) and the result follows 
by the induction hypothesis. 

Hence, assume that each rule in P has nonempty body. Let p be the number 



of rules in P. Then, p < ln/2\. Moreover, P G By Theorem |J, s{P) < 

2LP/2J < 2"/4^ □ 

Finally, let us observe that every antichain of sets of atoms is representable 
by a logic program. 

Theorem 2.4- For every antichain T oj finite sets there is a logic program P such 
that ST(P) = J- . Moreover, there exists such P with at most X^sej^ l-^l clauses 
and total size at most \ J- \ x X^sgjf I-^I- 

Proof. Consider a finite antichain T of finite sets. Let B ^ T. For every C & 
B ^ C , denote by xb,c a-n element from C\B (it is possible as J- is an antichain). 
Now, for each element b G B, define 

Tfc = not(a;_B,Ci), • • ■ inot(xB^cJ, 

where Ci, . . . ,Ck are all elements of other than B. Next, define a program Pb 
to consist of all rules r^, for b G B. Finally, define 

- U Pb- 

It is easy to verify that ST{Pjr) — T and that the size of Pjr is \T\ x X^se.^ I-^I- 
□ 

On one hand this theorem states that logic programs can encode any antichain 
T . On the other, the encoding that is guaranteed by this result is quite large (in 
fact, larger than the explicit encoding of T^. In the same time, our earlier results 
show that often substantial compression can be achieved. In particular, there are 
antichains of the total size of e(n3"/3) that can be encoded by logic programs of 
size 0(n). More in-depth understanding of applicability of logic programming as a 
tool to concisely represent antichains of sets remains an open area of investigation. 



APPLICATIONS IN STABLE MODEL COMPUTATION 



In this section we will describe algorithms for computing stable models of logic 
programs. These algorithms are recursive and are implied by Corollaries 2.1 and 
They select an atom (or a clause, in the case of Corollary 2.2) and compute 



2.2 



the corresponding reducts. According to Corollaries 2.1 and 2.2, stable models of 
P can be reconstructed from stable models of the reducts. However, it is not, in 
general, the case that every stable model of a reduct implies a stable model of P 
(see the comments after Corollary |2.2| ). Therefore, all candidates for stable models 
for P, that are produced out of the stable models of the reduct, must be tested 
for stability for P. To this end, an auxiliary procedure IS_STABLE is used. Calling 
IS_STABLE for a set of atoms M and a logic program P returns true if M is a stable 
model of P, and it returns false, otherwise. 

In our algorithms we use yet another auxiliary procedure, implied_SET. This 
procedure takes one input parameter, a logic program P, and outputs a set of atoms 
M and a logic program Pq (modified P) with the following properties: 



1. M is a subset of every stable model of P, and 



2. stable models of P are exactly the unions of M and stable models of Pq. 



11 



stable_models_a(P) 

Input: a finite logic program P; 

Returns: family Q of all stable models of P; 

implied_set(P, AI, Po); 

if (|Po| = 0) then return {M} 

else 

Q:=0; 

q := SELECT_ATOm(Po); 
Pi := Po(g+); 

L := STABLE_models_a(Pi); 

for all N e L do if IS_STABLe(Po, {q} U N) then Q := Q U {M U {q} U N}; 

P2 -.^Poiq-); 

L :— stable_models_a(P2); 

for all TV e L do if is_STABLe(Po, iV) then Q ■.= QU{MU N}; 
return Q; 



FIGURE 3.1. Algorithm for computing stable models by splitting on atoms. 



There are several specific choices for the procedure implied_SET. A trivial option 
is to return M = and Pq = P. Another possibility is implied by our comments 



following the proof of Lemma 2.1. Let T and F be sets of atoms that are true 
and false, respectively, under the well-founded semantics for P. The procedure 
IMPLIED_SET might return T as M, the program simp{P,T, F) as Pq. This choice 



turned out to be critical to the performance of the s- models system [ NS96 and 



expect, it will lead to significant speedups once our algorithms are implemented. 
However, in general, there are many other, intermediate, ways to compute M and Pq 
in polynomial time so that conditions (1) and (2) above are satisfied. Experimental 
studies are necessary to compare these defferent choices among each other (this is 
a subject of an ongoing work). 

We will now describe the algorithms. We adopt the following notation. For a 
logic program clause r, by head{r) we denote the head of r and by positivebody{r), 
the set of atoms occurring positively in the body of r. 

First, we will discuss an algorithm based on splitting the original program (that 
is, computing the reducts) with resp ect to a selected atom. This idea and the 
resulting algorithm appeared first in [3NV95|. The correctness of this method is 
guaranteed by Lemma 2T (or, more specifically, by Corollary ^.l| ). We call this 
algorithm STABLE_models_A. 

In this algorithm, to compute stable models for an input program P we first 
simplify it to a program Pq by executing the procedure implied_SET. A set of atoms 
M contained in all stable models of P is also computed. Due to our requirements 
on the implied_SET procedure, at this point, to compute all models of P, we need 
to compute all models of Pq and expand each by M. To this end, we select an atom 
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stable_models_r(P) 

Input: a finite logic program P; 

Returns: family Q of all stable models of P; 

implied_set(P, AI, Pq); 

if (|Po| = 0) then return {M} 

else 

r := SELECT_CLAUSe(Po); 
Pi := Po(r+); 

L :— stable_models_r(Pi); 

for all N £ L do if is_STABLe(Po, U positivebody{r) U {head{r)}) 
then Q ■.= QU{MUNU positivebody{r) U {head{r)}}; 

P2 := Po(r-); 

L := stable_models_r(P2); 

for all TV G L do if is_STABLe(Po, TV) then Q := Q U {M U N}; 
return Q; 



FIGURE 3.2. Algorithm for computing stable models by splitting on clauses. 



occurring in Pq, say q, by calling a procedure SELECT_AT0M. Then, we compute 
the reducts Po(<7+) and Po(g^). For both reducts we compute their stable models. 
Each of these stable models gives rise to a set of atoms {q} U N (in the case of 
stable models for Po((j+)) or N (in the case of stable models for Po(g~)). Each of 
these sets is a candidate for a stable model for Pq. Calls to the procedure is_STABLE 
determine those that are. These sets, expanded by M, are returned as the stable 



models of P. We present the pseudocode for this algorithm in Figure 3.1 



The second algorithm, STABLE_M0DELS_R, is similar. It is based on Corollary 



2.2. That is, instead of trying to find stable models of P among the sets of atoms 
implied by the stable models of P{q'^) and P{q~), we search for stable models of P 
using stable models of P(r+) and P(r^), where r is a clause of P. The correctness 



of this approach follows by Corollary |2.2|. The pseudocode is given in Figure 3.2 



Algorithms STABLE_models_A and STABLE_models_R can easily be merged to- 
gether into a hybrid method, which we call STABLE_MODELS_h (Figure 3^). Here, 
in each recursive call to STABLE_models_h we start by deciding whether the split- 
ting (reduct computation) will be performed with respect to an atom or to a clause. 
The function SELECT_mode( "atom", "clause") makes this decision. Then, depend- 
ing on the outcome, the algorithm follows the approach of either STABLE_M0DELS_A 
or STABLE_models_R. That is, either an atom or a clause is selected, the corre- 
sponding reducts are computed and recursive calls to STABLE_models_h are made. 

All three algorithms provide a convenient framework for experimentation with 
different heuristics for pruning the search space of all subsets of the set of atoms. 
In general, the performance of these algorithms depends heavily on how the selec- 
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tion routines SELECT_ATOM, SELECT_CLAUSE and SELECT_MODE are implemented. 
Although any selection strategy yields a correct algorithm, some approaches are 
more efBcient than others. In particular, the proof of Theorem 2.1 implies selecting 
techniques for the algorithm STABLE_models_h guaranteeing that the algorithm 

terminates after the total of at most 0(3"/^) recursive calls. 

Let us also observe that the recursive dependencies given in Corollaries |2.l| and 



2.2 indicate that in order to keep the search space (number of recursive calls) 
small, selection heuristics should attempt to keep the total size of P{q'^) U P{q^) 
or P(r+) U P{r~) as small as possible. 



stable_models_h(P) 

Input: a finite logic program P; 

Returns: family Q of all stable models of P; 

implied_set(P, M, Po); 

if (|Po| = 0) then return {M} 

else 

0-0; 

split jmode ~ SELECT_mode( "atom", "clause"); 

if {split jnode — "atom") then 
begin 

q ~ select_atom(Po); 
Pi := Po(g+); 

L := STABLE_MODELS_h(Pi); 

for all iV e L do if is_STABLe(Po, {q} U iV) then Q := Q U {M U {q} U N}; 

P2 - Po(g-); 

L ■— stable_models_h(P2); 

for all iV G L do if is_STABLe(Po, A^) then Q ■- Q U {M U A^}; 
end 

else (* split jnode — "clause" *) 
begin 

r ~ select_clause(Po); 
Pi - Po(r+); 

L ■— stable_models_h(Pi); 

for all N e L do if is_STABLe(Po, U positivebody{r) U {head{r)}) 

then Q ■- QU {M U N U positivebody{r) U {head{r)}}; 
P2 := Po(r-); 

L := stable_models_h(P2); 

for all N € L do if is_STABLe(Po, iV) then Q ■- Q U {A4 U A^}; 
end 
return Q; 



FIGURE 3.3. Hybrid algoritlim for computing stable models. 



The presented algorithms compute all stable models for the input program P. 
They can be easily modified to handle other tasks associated with logic program- 
ming. That is, they can be tailored to compute one stable model, determine whether 
a stable model for P exists, as well as answer whether an atom is true or false in all 



stable models of P (cautious reasoning), or in one model of P (brave reasoning). All 
these tasks can be accomplished by adding a suitable stop function and by halting 
the algorithm as soon as the query can be answered. 

The general striicture of our algorithms is similar to well-known Davis-Putnam 
method for satisfiability problem. The IMPLIED _SET procedure corresponds to the, 
so called, unit-propagation phase of Davis-Putnam algorithm. In this phase neces- 
sary and easy-to-compute conclusions of the current state are drawn to reduce the 
search space. If the answer is still unknown then a guess is needed and two recursive 
calls are performed to try both possibilities. But there are also differences. First, in 
our case, splitting can also be done with respect to a clause. The second difference 
is due to nonmonotonicity of stable semantics for logic programs. When a recursive 
call in Davis-Putnam procedure returns an answer, this answer is guaranteed to 
be correct. There is no such guarantee in the case of stable models. Each answer 
(stable model) returned by a recursive call in our algorithms must be additionally 
tested (by is_stable procedure) to see whether it is a stable model for the original 
program. 



DISJUNCTIVE LOGIC PROGRAMS 

In this section, we will focus on the class of disjunctive logic programs T>Vn.m- For 
a set of atoms {ai, . . . , am}, let us denote by d{ai, . . . , a^) the disjunctive clause 
of the form 

ai V . . . V flfe ■*— . 

By D{n,m), we will denote the disjunctive logic program consisting of n clauses: 
d{ai^i, . . . , ai,m) 

d{(ln,lt • • • : ^n,m), 

with all atoms Uij — distinct. It is clear that every set of the form 

{oj J. ■.i = l,...,n, l<ji<m} 

is an answer set for D{n, m), and that all answer sets for D{n, m) are of this form. 
Hence, 

\ST{D{n,m))\ = m". 

Consequently, general upper bounds on the number of answer sets for disjunctive 
programs in such classes that allow clauses of arbitrary length do not exist. 

Turning attention to the class 'D'Pn,m, it is now clear that, since D{n,m) e 

d{n, to) > to". 
The main result of this section shows that, in fact, 

d{n, to) = to" 

and the program D{n, to) is the only (up to isomorphism) extremal program in this 
class. 
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Consider a clause d of the form 

aiV . . .V ak ^ bi, . . . ,bp, not(ci), . . . , not(cg). 

By d"*" we will denote the clause obtained from d by moving all negated atoms to 
the head. That is, (i+ is of the form: 

oi V . . . V flfc V ci V . . . V Cg ^ &i, . . . , 6p. 

Let _D be a disjunctive program. Define 

D+ = {d+:deD}. 

Lemma 4-1- For every disjunctive logic program D, ST{D) C ST{D^). 

Proof. Let M e ST{D). Then, M is a minimal model of the Gelfond-Lifschitz 
reduct and, as is well-known, M is a model of D. It follows that M is a model 
of To show that M E ST{D^), we need to show that M is a minimal model 
of D+. 

Consider a model M' of _D+ and assume that M' C M. Take a clause 

ai V . . . V flfe ^ fei, . . . ,6,„ 

from Z?^^. Then, there is a rule 

ai V . . . V flfe ^ fei, . . . , 6,„, not(ci), . . . , not(c„) 

in D such that n > and ci, . . . , c„ ^ M. Since M' C M, ci, . . . , c„ ^ M'. Assume 
that {hi, . . . , bm} C M' . Then, since M' is a model of D (recall that it is a model 
of D~^), there is i, 1 < i < k, such that e M' . It follows that M' is a model of 
Z?^^. Since M is a minimal model of , M = A/'. Hence, M is a minimal model 
ofL>+. □ 



Lemma 4.1 allows us to restrict our search for disjunctive programs with the 
largest number of answer sets to those programs that do not contain negated oc- 
currences of atoms. 

Lemma 4-2. Let D be a disjunctive program with n rules di, . . . , c?„. Assume that 
for each i, I < i < n, di has empty body and exactly hi different disjuncts in the 
head. Then D has at most hi x ■ ■ ■ x hn answer sets. Moreover, if D has exactly 
hi X ■ ■ ■ X hn different answer sets, then no two rules have the same atom in 
their heads. 

Proof. Clearly, for each program whose every rule has empty body, answer sets 
are exactly minimal models. So, we have to prove that D has at most hi x ■ ■ ■ x hn 
minimal models. We will proceed by induction on the size of D (total number of 
literal occurrences in D). If the size of D is 1, the assertion holds. Consider now a 
disjunctive logic program D of size fc > 1, whose each rule has empty body. Assume 
D has n rules di, . . . , c?„ and that for each i, I < i < n, di has exactly hi different 
disjuncts in the head. 

Consider a minimal model M of D. Let a be any atom appearing in the head of 
di. Let M be a minimal model of D. Assume that a ^ M. Then, M is a minimal 
model of a program D' obtained from D by removing a from the head of each 
rule in which it appears. By induction hypothesis applied to D' , there are at most 
(hi — 1) X h2 X ■ ■ ■ X hn minimal models M oi D that do not contain a. Moreover, 
this number equals {hi — 1) x ft,2 x • • • x /i„ precisely if the heads of rules of D' have 
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hi — 1, /i2, . . . ,hn disjuncts in their heads, and if no atom appears in D' more than 
once. This happens precisely when no atom appears more than once in D. 

The other possibihty for M is that a g M. In this case, define D' to be a 
program obtained from D by removing aU clauses with a in the head (in particular, 
di is removed). Assume that D' = {di-^,...,di }. Since di is removed, p < n. 
Clearly, M \ {a} is a minimal model of D'. If D' ^ 0, by induction hypothesis, it 
follows that there are at most hi^ x ■ ■ ■ x hi^ < h2 y- ■ ■ ■ y- hn minimal model of D 
that contain a. Moreover, this number equals /i2 x • • • x /i„ occurs precisely when 
a occurs only in di and if no atom appears more than once in (i2, . . . , dn- 

It follows that the total number of minimal models of D is at most 

(/ll — 1) X /l2 X • • • X /l„ + ft,2 X • • • X /l„ = /li X ft,2 X • • • X /l„. 

It also follows that the number of minimal models of I? is /ii x • • • x /i„ if and only 
if no atom appears in D more than once. □ 

Theorem ^.l. For every integers m > 1 and n > 1, and for every program D G 
T^'Pn.m, \ST(D)\ < m". Moreover, the program D(n,m) is the only program in 
the class 'DVn,m for which the bound of m" is reached. In particular, d{n, m) — 

Proof. We will proceed by induction on n. The theorem clearly holds if rt = 1. It 
is also true if to = 1. So, assume that m > 2 and n >2. 

We will first focus on disjunctive programs in 'DVn,m that do not contain negated 
occurrences of atoms. Let D € "DVn.m be such a program, say D = {di, . . . , c?„}. 
Assume that the rule di has hi atoms in its head. 

If each clause in D has a nonempty body, D has exactly one answer set model, the 
empty set. Since to > 2, s{D) < to" (the inequality holds and D is not extremal). 

Next, assume that at least one rule in D has empty body. Let D' be a subset of 
D consisting of all the clauses with the empty body. Let n' denote the number of 
clauses in D' . Hence, n' > 0. Each minimal model for D can be obtained by the 
following procedure: 

1. Pick a minimal model M' of D' . If D = D' , output M' and stop. 

2. Otherwise, reduce D\ D' by removing clauses satisfied by M' as well as 
atoms from the bodies of the remaining rules that belong to M' . Call the 
resulting program D" . 

3. Pick a minimal model A/" of D" . 

4. Output M' U M" as a minimal model of D. 



Clearly, Lemma ^.2| applies to D' . Hence, \ST{D')\ < to" , with equality if and 
only if D' = D{n',ni). If D" = 0, then there is only one possibility for M" , 
namely M" = 0. If D" ^ 0, D" e VVn-'^rn, for some n" < n ~ n' < n. By 
induction hypothesis, |5'T'(L'")| < to" . Moreover, equality holds if and only if 
D" — D{n",m). Consequently, \ST{D)\ < to" x to" < to", with equality holding 
if and only ii D — D{n, to). 

Consider now an arbitrary program D g 'DVn,m- Assume that D is extremal. It 



follows from Lemma 4.1 that £>+ is also extremal. Hence, -D+ = D{n,m). Assume 



that D 7^ Then, there is a rule in D that contains at least one negated atom. 
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say a. It follows from the definitions of Z?^ and D(n,ra), and from the equality 
D+ = D{n,m) that: 

1. there is an answer set M of such that a ^ M, and 

2. no answer set for D contains a. 

Since ST{D) C 5T(D+), and since D'^ is extremal, it follows that D is not extremal, 
a contradiction. Hence, D = = D{n,m). □ 

Finally, we will consider the class VVn of all logic programs with the total size 
(number of literal occurrences in the bodies and heads) at most n. Let d'(n) be 
defined as the maximum number of answer sets for a disjunctive program in VVn- 
We have the following result. 

Theorem 4.2. For every n>2, d'{n) = e(2"/2). 

Proof. Assume that D has size n and that it has k rules. By Theorem 4.1 it 
follows that \ST{D)\ < , where m — [n/fc] . The value m'"', under the constraint 
TO = [n/fc] , assumes its maximum for k = [n/2j . Hence, for every disjunctive logic 
program D of size n, \ST{D)\ = 0(2"/^). In the same time, program Z?([n/2J,2) 
demonstrates that there is a disjunctive program D of size at most n such that 
\ST{D)\ = 0(2"/2) Hence, the assertion follows. □ 



Compared with the estimate from Theorem 2^ for the function s'{n), the func- 
tion d'(n) is much larger (it is, roughly the square of s'{n). Consequently, there are 
antichains representable by disjunctive logic programs with the cardinality of the 
order of the square of the cardinality of largest antichains representable by logic 
programs of the same total size. This may be an additional argument for disjunctive 
logic programs as a knowledge representation mechanism. 



5. CONCLUSIONS 

In this paper, we studied extremal problems appearing in the area of logic program- 
ming. Specifically, we were interested in the maximum number of stable models 
(answer sets) a program (disjunctive program) from a given class may have. We 
have studied several classes in detail. We determined the maximum number of 
stable models for logic programs with n clauses. Similarly, this maximum was also 
established for logic programs with n clauses, each of length at most 2, and for 
logic programs of total size at most n. In some of these cases we also charac- 
terized the extremal programs, that is, the programs for which the maxima are 
attained. Similar results were obtained for disjunctive logic programs. Our results 
have interesting algorithmic implications. Several algorithms, having a flavor of 
Davis-Putnam procedure, for computing stable model semantics are presented in 
the paper. 

Extremal problems for logic programming have not been studied so far. This pa- 
per shows that they deserve more attention. They are interesting in their own right 
and have interesting computational and knowledge representation applications. 



6. APPENDIX PROOF OF THE MAIN RESULT 

First, we prove auxiliary lemmas which will be used in the proof of Theorem 2.1 
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Lemma 6.1. For any n <1, sin) < s{n + 1). 

Proof. Let P be a program with n rules and s{P) stable models. To complete 
the proof it is enough to show that there is a logic program P' with n + 1 rules and 
s{P) < s{P'). Assume first that s(P) < 1. Then, as P' we can take any program 
with n+1 rules and 2 or more stable models (since n + 1 > 2, such programs exist). 

Suppose now, that P has at least 2 stable models. Let Mi, M2, be the 
all stable models of P. We construct P' as follows. Since stable models of a logic 
program form an antichain, every model Mi, I < i < k, is not empty. Let b be 
a propositional atom not occurring in P. Let A = {ai, 02, . . . , a;} be any set of 
atoms such that for all i,l < i < k, An Mi 7^ 0. Finally, let 

P' = {head{r) ^ body (r), not {b) : r G P}U 
{b 4— not(ai), not(a2), . . . , not(a/)} 

It is easy to see that Afi, M2, M^, {6} are stable models for P'. Thus, the proof 
of the lemma is complete. □ 

A clause r of P is called redundant if the head of r occurs (negated or not) in 
the body of r, or if there is an atom q such that both q and not(q) occur in the 
body of r. 

Lemma 6.2. If P is an extremal program with n >2 rules than: 

1. P contains no positive redundant literals, 

2. P contains no redundant rules, 

3. P contains no facts (i.e. rules with empty body), 

4. every head of a rule in P appears in the body of another rule in P. 

Proof. If P contains a positive redundant literal q in the body of a rule r then 
every stable model for P is a stable model for P{r~'). Hence ST{P) C ST{P(r^). 
So, from Lemma we have that 

s(P) < s(P(r")) < s{n - 1) < s{n). 

This means that P is not extremal. 

If P contains a redundant rule r then stable models of P are exactly the stable 
models of P{r~). Again, P is not extremal. If P contains a fact q <— then q must 
belong to every stable model of P. That is, 

s(P) < s{P{q+)) < s{n - 1) < s{n), 

and P is not extremal. 

Assume that P contains a rule r with head q and q does not appear negatively 
or positively in the body of any other rule. For any set of atoms M, M is a stable 
model for P if and only if M \ {q} is a stable model for P{q^). Hence, again 
s(P) < s(P(g"'")) < s(n) and P is not an extremal program. □ 

Lemma 6.3. Let n be a positive integer and n — 3m + where < / < 2. For any 
n > 3 



so(n) > 2so(n- 2). (6.1) 
Moreover, if I — then so(n) > 2so{n — 2), otherwise So{n) = 2s^{n — 2). 
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For any two integers x, y, such that x,y > 2 and 2 < max(x, y) < n, 

So{n) > soin- x) + so{n~y). (6.2) 
For any n > 5 

SQ{n)>so{n-l) + soin~A). (6.3) 

Moreover, if I = I then so(n) = SQ{n — 1) + so(n — 4), otherwise Sq^h) > 

so(n - 1) + sa{n - 4). 

For any integer x, such that 4 < x < n, 

so{n) > so{n - 1) + so{n ~ x). (6.4) 



Proof. Straightforward arithmetic for inequahties (6.1) and (6.3). Inequahties 
( |6.2[ ) and (6.4) are imphed by ( |6J| ) and ( |6.3D and mononicity of Sq- ^ 

Lemma 6.4- Let P be a logic program with n rules with pairwise distinct heads 
fli, . . . , a„. // the family of all stable models of P is {{ai}, . . . , {on}}, then 
P = CP[{ai,...,an}]. 

Proof. Consider the program P. Assume that it consists of rules ri, . . . , r„. With- 
out foss of generahty we will assume that the head of is ai, 1 < « < n. 

Observe that since ri is generating for {ai}, the only positive literal it may 

contain is ai. So, assume that oi appears positively in the body of ri. Then, P^ ^ 
contains the rule Oi ^ ai. Since all other rules in P^"'^ have atoms different from 
ai in their heads, ai does not belong to the least model of \ contradiction. 
Hence, ri has no positive literals. By symmetry, all rules have no positive literals 
in their bodies. 

Next, observe that ri is generating for {ai} but not for any other stable model 
{ai} [i ^ 1). Hence, all literals not(ai), 2 < i < n, must appear in the body of ri 
and not(ai) does not. Since ri has no redundant negative literals, 

ri = fli ^ not(a2), . . . , not(a„). 

By symmetry, it follows that P = CP[{ai, . . . , a„}]. □ 

To prove Theorem 2.1, we establish the basis of induction in Lemma 6.5 and the 
induction step in Lemma 6.6. 

Lemma 6.5. Let P be an extremal program with n, 2 < n < 4 clauses. Then, for 
some atoms a, b, c and d: 

1. ifn = 2,P = CP[{a,b}] i^B{0)), 

2. ifn^3,P^CP[{a,b,c}] (= A(l)), 

3. ifn = A,P = CP[{a,h,c,d}] (= C'{\)), or P = CP[{a,b}] U CP[{c,d}] 
(= Cil)). 

Proof. Let P be an extremal program with n clauses, 2 < n < A. Since P is 
extremal, P has at least n stable models (note that B{0) has 2 stable models, A{1) 
has 3 stable models, and C(l) and C"(l) have 4 stable models each). 

Let H be the set of heads of the rules in P. Then, each stable model of P is a 
subset of H, and all stable models of P form an antichain. If \H\ = 1, the largest 
antichain of subsets of H has one element. Thus, \H\ > 2. 
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Observe also that since P is extr emal, its rules contain no positive redundant 
literals in their bodies (Lemma 6^). Additionally, by the construction of P, its 
rules contain no redundant negative literals, either. Hence, the rules of P are built 
of atoms in H only. 

Assume first that n = 2. Then, \H\ = 2, say H = {a,b}. There is only one 
antichain of subsets of H that has two elements: {{a},{&}}- Hence, P has two 
stable models: {a} and {b}. The assertion follows by Lemma |6.4| . 

Assume next that n — 3. If =2, then the largest antichain of subsets of H 
has two elements, a contradiction (recall that P has at least three stable models). 
Hence, \H\ — 3, say H — {a, b, c}. The program P has three rules, say r, s and t, 
with heads a, b and c, respectively. 

There are only two antichains of subsets of H with three elements: 

(1) {{a, b}, {a, c}, {b, c}}, and 

(2) {{a},{fo},{c}}. 

Hence, the family of stable models of P (and, hence, also of P) is either {{a,b}, 
{a,c}, {6,c}} or{{a},{6},{c}}. 

Consider the first possibility. Assume that rule r contains a negative literal. 
Clearly, rules r and s are generating for {a, 6}. Thus, the only negative literal 
that they may contain is not(c). Reasoning in the same way, we find that the only 
negative literal that may be contained in the rules r and t is not(6), a contradiction. 
Hence, r and, by symmetry, s and t have no negative literals. Thus, P is a Horn 
program and has exactly one stable model, a contradiction. 

It follows that the family of stable models of P is {{a}, {6}, {c}}. Now, the 
assertion follows by Lemma 3.4. 

Finally, assume that n — 4. If < 3, the size of any antichain of subsets 
of H is at most 3. Since P has at least 4 stable models, \H\ = 4. Assume that 
H — {a, 6, c, d} and that P consists of rules r, s, and u with heads a, &, c and d, 
respectively. 

Let A be an antichain consisting of 4 or more subsets of H. Clearly, A contains 
neither nor H. Assume that A contains a one-element subset of H, say {a}. 
Then, there are exactly two possibilities for A: 

(1) ^= {{a}, {5}, {c}. Ml, and 

(2) A={{a},{b,c}Ab,d},{c,d}}. 

In the first case, the assertion follows from Lemma 6.4. So, let us consider the 
second case. In this case, rule r is not generating for any of the stable models 
{6, c}, {b,d} and {c,d}. Hence, {6, c}, {b,d} and {c,d} are the stable models of 
P \ {r}. This is a contradiction. We proved above that no 3-rule program can have 
the antichain {{6, c}, {6, d}, {c, d}} as its family of stable models. 

Next, assume that A contains a set with three elements, say {a, 6,c}. Then, 
there are exactly two possibilities for A: 

(1) A — {{a, b, c}, {a, 6, d}, {a, c, d}, {6, c, d}}, and 

(2) A = {{a, 6, c}, {a, d}, {6, d}, {c, d}}. 

Assume the first case. Assume that at least one rule in P, say r, has a negative 
literal. Since r, s and t are generating for {a, 6, c}, it follows that r has exactly one 
negative literal, not(d). But then, r is not generating for {a, 6, d}, a contradiction. 
Hence, r and, by symmetry, all the rules in P have no negative literals in their 
bodies. Consequently, P is a Horn program and has only one stable model, a 
contradiction. 

Thus, assume that A = {{a,b, c}^ {a, d}, {b^ d}, {c, d}}. Assume that r has a 
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negative literal. Reasoning as before, it follows that r has exactly one negative 
literal, not{d). But then, r is not generating for the stable model {a, d}, a con- 
tradiction. Hence, r and, by symmetry, s and t have no negative literals in their 
bodies. Assume that u has a negative literal in its body, say not(a;). Then, since 
u is generating for {a, d}, {h,d\ and {c, d}, x (jz. {a, d} U {6, d} U {c, d}, which is 
impossible. Hence, as before, P is a Horn program and has only one stable model, 
a contradiction. 

The last case to consider is when A contains only sets consisting of two elements. 
First, assume that some three sets in A contain the same element, say a. Then 
{a, 6}, {a, c} and {a, d} are all in A. Since r is a generating rule for all three stable 
models, it contains no negative literals and the only positive literal it may contain 



in its body is a. Since facts do not belong to extremal programs (Lemma 6.2), a 



is in the body of r. Consequently, a <— a is in ^ . Hence, a is not in the least 
model of p^""'^^ ^ g, contradiction. 

The only remaining possibilities for A are 

(1) ^ = {{a,c},{a,d},{6,c},{6,d}}, 

(2) ^ = {{a,5},{a,d},{6,c},{c,d}}, 

(3) ^={{a,5},{a,c},{c,d},{6,d}}. 

They are isomorphic, so it is enough to consider one of them only, say the first one. 

Assume that r has a positive literal in its body. Since r is a generating rule for 
{a, c} and {a,d}, it follows that r has exactly one such literal, namely a. Hence, 

rule a <— a is in P ' . Since no other rule in P '° has a as its head, a is not in 
the least model of p^"'''^ ^ a contradiction. Hence, r and, by symmetry, all rules in 

P^ ' ^ have no positive literals in their bodies. 

Next observe that r is generating for {a, c} and {a, d} and it is not generating 
for {6, c} and {6, d}. Since it has no positive literals in the body, it follows that 
r = a ^ not (6). By symmetry, clauses h ^ not (a), c ^ not(d) and d ^ not(c) 
are aU in P. Hence, P CP[{a, b}] U CP[{c, d}] . □ 

Now, we will establish the induction step. 

Lemma 6.6. Let n be an integer, n > 5. Assume that every extremal program with 
2 < n' < n rules and no redundant atoms is a 2, 3, A-program. If P is an extremal 
program with n > 5 rules and no redundant atoms than: 

1. P contains no two rules with the same head 

2. P contains no atoms that appear only positively in the bodies of the rules in 
P 

3. P contains no rules of the form q ^ p 
4-. P is a 2,3, A-program 

Proof. Our assumption that every extremal program with 2 < n' < n rules and 
no redundant atoms is a 2, 3, 4-program implies that for every n' , 2 < n' < n, 
s(n') = so(n')- 

(1) Let r = g ^ ai, . . . , flfe, not(6i), . . . , not(6;) be a rule in P. Assume that there 



is another rule r' with head q. From Lemma 3.2 it follows that fc > or Z > 0. 



Moreover, from Lemma we have that that there is a rule r" such that q appears 
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in the body of r" . Also, since there are no redundant rules in P, r" is different 
than r and r' . 

If q appears positively in the body of r" then |P((7^)| < n — 3. Since |P(g+)| < 



n — 2, the inequality ( |6.2| ) in Lemma 6.2 and the inductive assumption imply that 
s{P) < s{P{q+)) + s{P{q-)) < sn{n - 2) + So{n ~ 3) < SqH- 

So, P is not extremal. 

Assume then that q appears negatively in the body of r". Now, \P{q~)\ < n — 2, 
< n — 3 and we can show that s{P) < so{n) in the same way as before. 
Hence, P contains no two rules with same head and (1) follows. 

Therefore, for every atom q which appears as a head in P, there is exactly one 
rule with head q. We will denote this rule by r{q). 

(2) Assume that P contains an atom q which appears only positively in bodies of 
rules of P. There is a unique rule r(q). Let 

riq) = g ^ ai, . . . , a;, not(6i), . . . , not(fo„) 

and P' be the program obtained from P by replacing every premise q by the se- 
quence ai, .. .,ai, not(6i), not(6,„). Then |P| = |P'| and the programs P and P' 
have the same stable models. Also, P' co ntains an atom which never appears in a 
body of a rule in P. So, from Lemma it follows that P' is not extremal. Hence, 
s(P) < s{n), a contradiction. 

(3) Assume that P contains a rule of the form r = q p. Since there is only one 
rule in P with head q, for every stable model M oi P, q ^ M if and only if p ^ M . 
Let P' be the program obtained from P by replacing every premise not(g) by the 
premise not(p). Clearly, P and P' have the same stable models. In addition, P' 
contains an atom which does not appear negated in P'. From part (2) of this proof, 
it follows that P' is not extremal. Consequently, since P and P' have the same 
number of rules and the same number of stable models, P is not extremal, contrary 
to the assumption. 

(4) Assume first that P contains a rule r of the form q <— not(p). Let AI e ST{P). 
If Q € M, then M \ {q} G ST{P{r+)). Uq^ M, then, M G ST{P{r-)) and p G M. 
Hence, M\ {p} G ST{{P{r~)){r{p)~^)) (recall that r{p) is the unique rule in P with 
p as its head, cf. part (1) of the proof). Hence, 

s{P)<siP{r+)) + s{{Pir-)){r{p)+)). 

Observe now that |P(r+)| < n — 2 — S, where 5 is the number of rules different 
from r{p) and containing not{q) in the body. 

Next, observe that \{P{r^)){r{p)^)\ < n — 2~e, where e is the number of literals 
in the body of r{p) different than q and not(g). Therefore, 

s{n) = s(P) < s(P(r+) + s{{P{r-){r{p)+) < s{n - 2 - 5) + s{n - 2 - e). 



If 5 > or e > then the inequality |6.2| of Lemma 6^ and the equality s(n') = 
so(n'), for 2 < n' < n, imply that s{n) < so{n). It follows that 6 ^ 0, e = and both 
P(r+) and P{r^){r{p)^) are extremal. Moreover, since e = 0, r{p) = p ^ not{q) 
(P does not contain redundant rules and rules of the form p ^ q). 

Let P' = P \ {r,r{p)}. Since 5 = 0, it also follows that there are no rules in 
P' with not(g) in the body. By symmetry, it follows that no rule of P' contains 
not(p). 

Assume now that there is a rule in P', say r', containing q in its body. Again, let 
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M e ST{P). If g e M, then M \ {q} is a stable model of {P{q+)){p-). Otherwise, 
Mis a stable model of Since | (F(q+))(p-)| < n-2 and\{P{p+)){q-)\ < 

n — 3, 

s{P) < s{P{q+){p-)) + s{P{p+){q-)) < s{n - 2) + s{n - 3) 
— so{n — 2) + so{n — 3) < So(ri) < s{n), 

a contradiction. Hence, neither q nor (by symmetry) p appear in P'. It is easy 
to see that P' = P{r^). Since P(r+) is extremal, P' is extremal. It follows by 
induction that P' and, consequently, P are both {2, 3, 4}-programs. 

From now on, we will assume that every rule in P has at least 2 literals in 
the body. Assume that there is a rule r in P with a positive literal, say a, in its 
body. Since the body of r{a) has at least two literals, |P(a+)| < n — 3. Since r 
has a in its body, |P(a^)| < n — 2. It follows that s{P) < s{n — 3) + s{n — 2) = 
so{n — 3) + so{n — 2) < so(n) < s{n), a contradiction. Hence, every rule in P has 
only negative literals in its body. 

Assume next that there is a rule r in P with fc > 4 literals in the body. Let 
q be the head of r. Then |P(g+)| < n - 5 and \Piq~)\ < n - I. Hence, s{P) < 
s{n — 5) + s{n — 1) = so(n — 5) + so(n — 1) < so(n) < s(n), a contradiction. It 
follows that every rule in P has 2 or 3 literals in its body. 

We will show now that P is a {2, 3, 4}-program. To this end, we will consider 
two cases. First, we will assume that all rules in P have exactly 3 negative literals 
in their bodies. Consider a rule r from P, say r is of the form: 

a ^ not(6), not(c), not{d). 

Assume that the rules r{b), r(c), and r{d) are of the following respective forms (by 
our assumption, each must have exactly 3 negative literals in the body): 

b <— not(a;), not(y), not(z) 

c ^ not(a;'), not(y'), not(z') 

d ^ not{x"), not(j/"), not(z"). 

Assume that at least one of the atoms x, y, z, x' , y', z', x", y" and z" is not in 
{a, 6, c, d}. Without the loss of generality, we may assume that x" ^ {a, 6, c, d}. 

For a stable model M of P, let Gm denote the set of generating rules for M . 
Then, we have the following four mutually exclusive cases for M: 

(i) r(a) e Gm 

(ii) r{a) ^ Gm and r{h) £ Gm 

(iii) r(a) ^ Gai, r{h) ^ Gm and r(c) e Gm, and 

(iv) r{a) i Gm, r{h) i Gm, r{c) ^ Gm and r{d) S Gm- 



If r(a) e Gj\/ then by Corollary M \ {a} is a stable model of P(r(a)"'"). Since 
|P(r(a)+)| < n — 4 the number of stable models for which (i) holds is bounded by 
s{n - 4). 

Similarly, by considering P(r(&)+) and P(r(c)+) we have that the number of 
stable models for which (ii) or (iii) hold is bounded, in each case, by s{n — 4). 

Consider P(r(d)+). Since x" ^ {a, 6, c, d}, the number of stable models for which 
(iv) holds is bounded by s(n — 5). Hence, s(P) < 3s(n — 4) + s{n — 5). Lemma 
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6.1 implies tha t s{P) < Asjn — 4). Using the inductive assumption and, twice, the 
inequahty |6.l| of Lemma 3.3 we have that 4s(ri — 4) = Aso{n — 4) < so{n). So, 
s{P) < so{n) < s{n). This is a contradiction. Consequently, all atoms appearing in 
the negated form in the bodies of the rules ^(6), r(c) and r{d) belong to {a, b, c, d}. 
Hence, {r{a),r{b),r{c),r{d)} ^ CP[{a,b,c,d}]. 

Let us now observe that none of not (a), not (6), not(c) and not (6) appears in 

P\{r{a),r{b),r{c),r{d)}. 

Indeed, if, say not(a), appears in the body of a rule r{q), where q ^ {a, 5, c, c?}, then 
one can show that s(P) < s(n — 5) + s(n — 1) = SQ{n — 5) + SQ{n — I) < so{n) < s{n), 
a contradiction. 

Since s(P) < s{P{a+)) + s{P{a-)) < s{n - 4) + s{n - 1) so(n - 4) + 
so(n — 1) < so(n) < s(n), it follows that P(a+) is extremal and that P{a^) = 
P \ {r{a), r{b), r(c), r{d)}. Consequently, P \ {r{a),r{b),r{c),r{d)} is a {2, 3, 4}- 
program. Thus, P is a {2, 3, 4}-program. 

To complete the proof we need to consider one more case when P contains a 
rule, say r(a), with exactly 2 negative literals in the body. Let us assume that 

r{a) — a ^ not(6), not(c) 

Let us also assume that r{b) has literals not(a;) and not(j;) in its body (and, 
possibly, one more) and that r(c) has literals not(2;') and not(y') (and, possibly, 
one more) in its body. If r{b) or r(c) has three negative literals in its body or if at 
least one of x, y, x' and y' is not in {a, 5, c}, reasoning as in the previous case we 
can show tha t s{P) < 2s{n — 3) + s{n — 4) = 2so{n — 3) + SQ{n — 4) < 3so(n — 3). 
Corollary 2.2 implies that 3so("- — 3) < so(n) < s{n). Hence, s{P) < s{n). This is a 
contradiction. Hence, {r{a),r{b),r{c)} — CP[{a,b,c}]. Moreover, again reasoning 
similarly as before, we can show that none of not(a), not(6) and not(c) occurs in 
P \ {r{a), r(b), r(c)}. Hence, s{P) < s{P{a+)) + s{P{a-)) < s{P{a+)) + 2sa{n - 
3) < 3so(n — 3) < so{n) < s{n). It follows that P(a+) is extremal. Moreover, 
P{a+) ^ P \ {r{a),r{b),r{c)}. Consequently, P\ {r{a),r{b),r{c)} is a {2,3,4}- 
program and, thus, so is P. □ 

We can now complete the proof of Theorem 2.1 . Let P be an extremal program. 



Then, by Lemmas |6.5| and 6.6, P is a 2,3,4-program. Thus, by Corollary 2.3, 
P £ En- Consequently, s(n) — SQ{n). □ 
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